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It is well known that open dynamical systems can admit an un- 
O countable number of (absolutely continuous) conditionally invariant 

measures for each prescribed escape rate. We propose (and illustrate) 
a convex optimisation based selection scheme (essentially maximum 
entropy) for gaining numerical access to some of these measures. The 
t-h work is similar to the MAXENT approach for calculating absolutely 

j>! continuous invariant measures of nonsingular dynamical systems, but 

contains some interesting new twists, including: (i) the natural escape 
rate is not known in advance, which can destroy convex structure in 
the problem; (ii) exploitation of convex duality to solve each approxi- 
mation step induces important (but dynamically relevant and not at 
first apparent) localisation of support; (iii) significant potential for 
non-rigorous application to the approximation of other dynamically 
interesting objects (for example, invariant manifolds). 
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1 Nonsingular open dynamics 



Let (X, m) be a measure space. We consider the dynamics generated by a 
transformation on a subset of X which fails to be forward invariant; 
such a dynamical system is called open and may or may not support any 
recurrent behaviour. Let A C X be measurable and let T : A — > (A U Hq) 
be a measurable transformation where 



• H C X \ A is measurable; and 

• m(T- l Ho) > 0; and 

• m(E) > whenever m(T~ 1 E) > and E is a measurable subset of X; 

• T is locally finite-to-one (for each x G A, T _1 (x) = G A : T(x_i) = 
x} is either empty or finite). 

Definition 1. We calQ (T, A,m\A) satisfying the above conditions a non- 
singular open dynamical system. 



Notice that T(x) is defined only for x G A, and the "hole" H can be used 
to define a survival time for each x £ A: 



Tlx) 



n if x, T(x), . . . T n (x) G A and T n+1 (x) G H 
oo if T fc (x) G A \/k G Z+. 



When t(x) = n < oo, T n {x) G #i := An T-\H ) and such orbits of T 
terminate at time r(x) + 1. Only those x for which r(x) = oo can exhibit 
recurrent behaviour. 



The main goal of this paper is to develop a new class of computational meth- 
ods for investigating dynamically meaningful probability distributions on A. 

1 Clearly m o T^ 1 <mso that T : (A, m|x) {X, m) is a nonsingular transformation, 
but T : (A,m\j\) — > (X,m\A) fails to be non-singular, as o T~ 1 (H ) = m^-Hi) > 
while m\A(H ) = 0. 
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Definition 2. The escape rate of a probability measure m on A is 
p mo := lim --logm {x : r(x) > n} 

n— »oo Tl 

(when such a limit exists). For later use, define the n step survivor set as 

A n :={xeA : r(x) > n} = {x : x, T(x), . . . , T n (x) G A} = f] n k=0 T' k A. 
Note that A = A. 

Definition 3. A probability measure \x on A is conditionally invariant iff 

there is a 6 (0, 1) such that 

n(T~ 1 E) = a fi(E) Vmeasurable E C A. 

The idea of conditionally invariant measures (CIMs) dates at least to Pi- 
anigiani & Yorke [20], who used them to study metastability in expanding 
interval maps. The escape rate of such a measure is p M = — \og^{A\). In 
fact, 

At{r >n}= /i(A n ) = p(A n T~ 1 y4 n „ 1 ) = a |i(A^i) = • • • = a" //(A) = a" 

so that fi(Ai) = a = e _PM . Hence fi(A n ) = e~ Pfl?1 so that initial conditions 
distributed according to \x display geometric escape. One of the interesting 
challenges is to find conditionally invariant measures which model the escape 
statistics of the "natural" initial measure m\A, and describe the distribution 
of orbits prior to escape; we refer to [TT] for discussion of this, and related, 
issues. 



2 Construction and support of conditionally 
invariant measures 

For all that follows it is convenient to decompose A into invariant and tran- 
sient parts. First, let := n n > A n . The open system (T, A, m|^) will 
satisfy the escape hypothesis iff 

miA^) = 0. (1) 
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Clearly, if there is an escape rate p m > then (IT]) holds. Next, put H n := 
v4 n __i \ A n = {t = n — 1}. Note that T(H n ) C H n -i, although it is not 
necessarily true that T(H n ) = H n _i (T : A\ — > A may not be onto). To deal 
with the fact that some points in A may have no preimages, put 

K := {x : Af] T~ x x = 0} and K n := {x : ^ (A n T- n (a;)) C K } 

= {x : min{fc : A H T _fc s = 0} = n + 1}. 

Notice that for each n, K n +i C T(K n ), but the containment may be strict. 
Let 

Koo := {x : there is no sequence {x_ n }^ 1 such that T(x_ n ) = x_( n _i), T(x_i) = x}. 

Points in are 'backwards transient', while points in := U n>0 (H n \Koo) 
are 'forwards transient'. Clearly, \J^ =0 K n C and the union on the left 
may be finite or infinite (or even the emptyset if T is onto A) 

Lemma 1. Let (T, A,m\A) be a nonsingular open dynamical system. IfQ = 
Aoo \ then A admits the disjoint decomposition A = U Q U and 



1. T^^Koo) C (mod m\ A ); 

2. T(Q) = Q; 

3. T : (H n \ Koo) (Hn-i \ Koo) is onto and nonsingular (with respect 
to the obvious restrictions ofm); 

4- Koo = ^n° = oK n . 



Proof. (1) Note that each T~ l K n+l C K n and T~ 1 K = 0. (2) If x G 
then x G so T n (x) G A^. Thus Q is the set of points whose future orbit 
is contained in A and has at least one backwards orbit in A. (3) Let x G 
H n -\ \ Koo- Then there is a sequence {x-k}kLi such that T(x-k) = £-(fc-i) 
andT(x_i) = x. Clearly x-\ G H n \Koo- (4) First, suppose that a; ^ U n >oK n . 
Then i ^ iT so ^ T~ 1 x. If T _1 a; C U n >oi£n then there are iVi , . . . , Nj 
such that T~ 1 x C U • • ■ U K^.. Putting iV = 1 + max{A^ 1; . . . , iV}} one 
has a; G i^jv, a contradiction. Thus, there is at least one x_i G T _1 x such 
that x_i ^ U^oA'n. The proof is completed by induction. □ 
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Lemma 2. Let T satisfy the conditions of Lemma^ 

1. if fi is an invariant or conditionally invariant measure on A then 

2. if fi is an invariant measure then /i.(i?oo U K^) = 0; 

3. if fi is a conditionally invariant measure then fi(Q U K^) = 0. 

Proof. (1) Suppose that /i o T _1 = a fi for some a G (0, 1]. Then 

a n+1 fi{K n ) = fi o T^ n+1 \K n ) = fi o T-\T~ n K n ) < fi(T~ l K ) = fi($) = 0. 

By part (4) of Lemma[l| fi^) = fi{U n K n ) < J2 n ^( K n) = 0- (2) If fi is an 
invariant measure and fi(H n ) > then by the Poincare recurrence theorem 
almost every x G H n recurs to H n infinitely often. But if x G H n then 
{k > n : T k x G H n } = 0, so fi(H n ) = 0. It follows that fi{UH n ) = and 
hence ^{H^) = 0. The result now follows from (1). 
(3) By Lemma [l] (2), fi C T^T^)) C T^tt so that 

fi(n) <fio T-\n) = a fi(n) < 1 //(fi). 

Hence //(fi) = 0, and the result follows from part (1). □ 

The picture revealed by Lemmas [T] and [2] is that A decomposes into three 
pieces: 

(i) a backwards transient part which cannot support any CIMs, but 
includes any local basins of attraction (we will later identify numerically 
certain parts of and exclude them for computational reasons); 

(ii) an envelope fi = Aoo \ for the "recurrent" piece which can support 
invariant measures, but not CIMs; and 

(iii) a transient part which is the place to look for CIMs (and includes 
any local unstable manifolds) 

These decompositions are nontrivial, as the following example shows. 
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Example 1. Let X = R 2 , A = [0, l] 2 and T(x,y) = (2x,l/2y). Then 
H n = (2" n , 2~( n ~ 1 )] x [0,1], = {0} x [0,1]. On the other hand, K n = 
[0, 1] x (2-( n+1 ), 2-"], so K x = [0, 1] x (0, 1]. The "recurrent set" A 00 nH 00 = 
{(0, 0)} is a fixed point (so genuinely recurrent), and = {0} x (0, 1] (the 

stable manifold to (0, 0)). Any CIM must be supported A\K ao = [1, 0] x {0} 
(the unstable manifold to (0,0)). 

Remark 1. As noted already, a discrete variant of the set U n > K n arises 
naturally in the numerical methods described below. When T is countable- 
to-one, it can occur that ^ U n K n =: K'^, but this does not alter the 
result of Lemma [2t 1 ) • 



Conditional transfer operators 



For each k > put vrtk = m\A k (so that mo = itl\a)- Then T : (Ak+i, rrik+i) — > 
(Ak, rrik) is a nonsingular transformation, so that rrik+i o T _1 <C rrik and a 
conditional Frobenius-Perron operator Ck : L 1 (Afc + i; m^+i) — > L 1 (Ajt;m/ c ) 
can be defined in the usual manner: 

£kf = j — ([fm k+1 ] o T _1 ). 

Dual to Ck is the (conditional) Koopman operator Uk ■ L^^A^mk) — > 
L°°(Ak+i; rrik+i) with the action 

U k ip — i/joT. 

The relation 

(C k p) ip dm k = I (p U k ip dm k+ i (2) 



is automatic for tp G L 1 (y4 fc+1 ; m fc+1 ), ip G L°°(Ak] m k ). In particular, for any 
ip G L X (A; m ) and ip G L°°(A; m ), 

/ C ((f l^x) ip dm = / (pU ^pdm. (3) 

J An J A-i 



The next lemma concerns density function of CIMs which are absolutely 
continuous (AC) with respect to m. 



6 



Lemma 3. Let (T, A, mj^) be a nonsingular open dynamical system 



1. ji <^ m is a CIM with escape rate — log a if and only if Cq{1a 1 -^ 1 ) = 

(andfi(A ) = l). 

2. Suppose there is n > such that C 1a 1 > k1 Hoo . Then ifip k £ L 1 (H k \ 
K^] m k ) there is (p k+1 e L l (H k+l \ K^; m k+l ) such that C k ip k+1 = ip k 
and J ip k dm = f ip k+ i dm. 



Proof. (1) Let (p = Then for E C Aq, one has T ^ C so that, using 
equation (|3j) 

/ £0(1^1 <fi) dm = / (pU l E dmi = \ <p 1 t -^e dm = ^{T~ l E). 
Je J a x J 

Since a J E (pdm = a fi(E) = [i{T~~ l E), the first part of the lemma follows. 
(2) Put tjj k+ i = ijj k o T/UkCklHk+xXKoo- Assume that is bounded (the 
general case follows from the bounded case by a standard argument). Let 
fij = tpj mj for j — k, k + 1 and E C H k \ K^. Then 

fi k+ ioT~ 1 E= (p h+1 U k l E dm 

J Hi s+ x\K 00 

= U k (ip k l E /C k l Hk+1 \ Koo )l Hk+1 \ Koo dm= tp k l E dm = fi k (E). 

JA k+1 JA k 

Thus > V* = = d^^+i = = C ^k+i- The equality of 

integrals follows using E = H k \ and Lemma [T](3). □ 



Multiplicity of CIMs 



Provided ifoo 7^ 0, Lemma []J3) implies the existence of at least one back- 
wards semi-orbit {x- k } k >o (with T(x- k ) = x^fk-W); Demers and Young [11] 
point out that a CIM can be obtained as (1 — a) Y2T=o ak ^x^ k - Indeed, many 
CIMs can be constructed which are AC with respect to m. The following 
result is essentially that of Demers and Young [TT1 Theorem 3.1]. 
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Theorem 1. Let (T,A,m) be a nonsingular open dynamical system. If there 
is k > such that £o1ai > K 1h x an d m (-^oo) > then for every a £ (0, 1) 
there is a CIM which is AC with respect to m and has escape rate — log a. 



Proof. There is at least one N for which itl{Hm \ K^) > 0. By an inductive 
application of Lemma [l](3) , m(H\ \ K^) > 0. Now let [i\ <C m\ Hl \ Koo be a 
finite measure and put (pi = Note that 1^ 1 (pi = 0. By Lemma 3^2), 
one can construct (inductively) a sequence of integrable functions (pk, sup- 
ported on H k \ such that each jCc^I^^+x) = £ k (p k+1 = <p k . Put 
V = ^^)E^li« fc ~Vfc- Then, j Ao P>dm = 1 and £0(1^) = aip. The 
theorem follows from Lemma [3^ 1). □ 

Remark 2. The proof given above is essentially the one from [TT]; the dif- 
ferent conditions are to account for the fact that we have not imposed any 
topological (or smoothness) restrictions on T. Note that each choice of finite 
AC measure on H\ \ Koo gives a different ACCIM. 



Discussion 



Lemma [3] characterises absolutely continuous conditionally invariant mea- 
sures (ACCIMs) as those whose density functions solve a conditional transfer 
operator equation: ^(IaiV 9 ) = ap. However, in contrast to the typical situ- 
ation for nonsingular dynamical systems, this equation may have an uncount- 
able number of solutions for each a if no additional regularity is specified; 
see discussion in There can exist distinguished ACCIMs with specified 
regularity: by working in a suitable Banach space, the conditional Frobenius- 
Perron operator may be quasicompact, admitting a "natural" ACCIM, giving 
m a well-defined escape rate. See, for example, [U] for dynamics on Markov 
towers; [HJ [TO] for interval maps modelled by Young towers; [H E] for expand- 
ing circle maps and subshifts of finite type; [19] for interval maps with BV 
potentials. Among the motivations for the introduction of ACCIMs by Piani- 
giani and Yorke were notions of metastability in complex systems [201 p353] . 
More recently, Homburg and Young [17] made productive use of CIMs to 
analyse intermittent behaviour near saddle-node and boundary crisis bifur- 
cations in unimodal families. Many authors have continued to obtain results 
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connecting escape rates and metastable behaviour of closed systems; see, for 
example, [H El E21 M, EH EE] • 



3 Moment formulation of the ACCIM prob- 
lem 



We now describe a selection principle for ACCIMs based on the Shannon- 
Boltzmann entropy. The idea is to encode the criteria for being a CIM into a 
sequence of moment conditions, and to search for approximate CIMs which 
locally resemble the incumbent measure m. By Lemma [3j if fi is an ACCIM 
and (p = 4z: then 



dm 



ip dm = fi(Ai). 



£ (l Al (p) = ®<P, a = 

J Ai 

This is equivalent to 

/ [C (l Al <f) - atp] ipdm = VV> 6 L°°(A; m), (l Al ip)dm = a 

Ja ' J 

and hence, using equation (J3]), 

/ [l Al ip ° T - aip] ip dm = V^GL°°(A;m), / ipdm = a. 

JA J Ax 

To obtain a computationally tractable representation of these conditions, ob- 
serve that it suffices to verify for all ip in a weak* dense subset of L°°(A; mo)- 

Definition 4. Let {ipj}f = i C L°°(A; m ) be a sequence whose span is weak* 
dense and put ipo = 1 A . Fix a G (0, 1]. Let 

3~n '■= |o < V G L l (A; m ) : J (pdm—l,J [l Al ipj ° T — aipj) cp dm = 0, j 

Then J- n is the set of approximately conditionally invariant densities 

with escape rate — log a. 
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Notice that each 3F n +\ C J- n . If a sequence {/„} is chosen such that each 
/„ G T n and f n ~^ weak then /«, G n n>0 .Fn- Such an is the density of 
a CIM. Following the approach of [I], one can ensure weak (and indeed L 1 ) 
convergence of such a sequence by selecting f n to solve 

maximize H(f) s.t. / G T n (P n ) 

where if is a suitably chosen functional. We use the Shannon-Boltzmann 
entropy 

H(f) = - f(x) log f(x)dm(x) 

J A 

(where t logt is set to when t = and oo when t < 0). If T admits an 
ACCIM /i for which H(4^) > — oo, then each problem (P n ) has a unique 
solution f n , and lim/ n exists both weakly and in L 1 (proofs can be adapted 
from jl]). 



Each problem (P n ) is concave, admitting a solution f n a depending on both 
n and a. As we illustrate with numerical examples (Section |5| the role of a 
is interesting, being a parameter that is tunable to produce a range of escape 
rate^j for a near 0, escape is rapid (with mass of the ACCIM tending to 
concentrate on the first few preimages of the hole); for a near 1, escape is 
slow with mass concentrated nearer to Q. 



In order to identify the "most uniform" ACCIM we propose a nested ap- 
proach: at the outer level, for each fixed n, optimise H(f n ^ a ) (over a); as an 
'inner' step, each /„ )Q is computed to solve (P n )- 

Remark 3. The optimisation problem (P n ) can be reformulated to remove a 
as a variable. One simply replaces the jth moment condition in the definition 
of T n with 



l^i i>j ° T — (f A ip dm) if)j ip dm = 

for each ipj. This destroys the linearity of the constraint, and potentially the 
convexity of the optimisation problem. 



2 The flexibility to tune a without impact on numerical effort is reminiscent of the use 
of Ulam's method to calculate the topological pressure of piecewise smooth dynamical 
systems by varying an inverse temperature parameter |15j . 
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4 Solution for fixed a via convex duality 



Let n, a and {ipk}k=o fi xe d- To simplify matters we assume that the test 
functions (excluding ip = 1^ ) form a partition of unity over A, so the ip Q 
condition 

= / [l^i l^o ° T — a 1^ ] (p dm = / (pdm — a / (pdm 
Ja J Ai Ja 

follows from the corresponding conditions for ipi, . . . , ip n . The normalisation 
f Ao <f dm = 1 can thus be invoked using f A ^ <p dm = a. 

Definition 5. Define M : L l (A]m ) -> W +1 by 

(M(/?) = / (pdm and (M(p)j = / [lA^j ° T — atpj] cp dm 

J A! J A 

for j = 1, . . . , n. Let M* : R n+1 L°°{A; m ) be defined by 

n 

M*A = A l Al + Yl H^a^j o T -ai>j). 

Let e = [1,0,..., 0] T G R n+1 , put Q(A) :=aA r e-/ A exp(M*A - 1) dm and 
define a new problem: 



maximise Q(A) s.t. A e M n+i (£>„) 

This notation is useful for recasting (P n ) in dual form. First, note that 
feJ r n ^Mf = ae and \ T (Mf) = [ M*\ f dm Vf E L\A;m). 

J A 
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Now, for every A G 



sm+l 



sup H(f) = sup H(f) 

feF n {/ : M/=oe} 



sup [H(f) + X T (Mf -ae) 

{/ : M/=ae} 

< sup [H(f) + X T (Mf -ae)} 

f£Li(A;m) 



-a \ T e + sup 



l*\fdm-(-H(f)) 



—a A T e + H*(M*X) 

-a\ T e+ / exp(M*A - 1) dm = -Q(X) 



where H* is the Fenchel conjugate of the convex functional —H, and the 
second to last equality is a nontrivial result in convex analysis (see Rockafel- 
lar |2T] and Borwein and Lewis [3j). Observe that — Q(X) is an upper bound 
on H(f) for all / G J- n and A G IR n+1 so that the (negative of) the solution 
to (D n ) provides an upper bound on the solution to (P n )- This is called the 
principle of weak duality. In fact, (D n ) is a differentiate, unconstrained, 
concave maximisation problem, and our method involves solving it! 

Theorem 2 (Dual attainment). Let a,n be fixed. 

1. A* solves (D n ) if and only if f n '■= exp(M*A* — 1) G T n and H(f n ) = 

-QW; 

2. the problem (D n ) attains its maximum if and only if 

/ A G {kerM* © span(e)} L => [M*A] + ^ m-a.e.. (4) 



Proof. (1) This is a standard result in dual optimisation theory, and is a 
consequence of the fact that A* solves (D n ) iff a [eL- — [Mexp(M*A* — 1)]^ = 
|?-|a* = for j = 0, . . . , n. (2) Sufficiency of (4) is established by minor 
modifications to the proof of Theorem 3.3 in [5]. For necessity, suppose that 
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A T e = 0, ^ A € {kerM*} ± and M*X < 0. Then there are re > and E C A 
such that m(£) > and M*A <-k1 £ . Then, for any A f G M n+1 and t > 0, 

Q(A f + t A) > Q(A f ) + (1 - e~ K *) / exp(M*A f - 1) dm > Q(A f ). 

Hence Q cannot attain its maximum. □ 



Domain reduction and dual optimality conditions 

The condition Q incorporates two important facts about ACCIMs. First, 
by Theorem [TJ there exist ACCIM. It follows from this that T n ^ and 
ae G Range(M) = {kerM*} 1 - (this is the reason for separating out the 
direction e). Second, a function ip will be called a bad function if 1^ ift o 
T — aip < (but not equal to m-a.e.). If A G IR n+1 is such that [A]o = 
and M*A < (but nonzero), then ip = Y^=i[Mj V'j is a bad function. The 
condition in Theorem [2] is that the solvability of (D n ) requires there to be no 
bad functions in span{ , 3 -}" =1 . We are going to show that bad functions may 
exist (Example [2j, but they are irrelevant to the ACCIMs (their supports are 
disjoint from H^; see Lemma [2^3) and Lemma [4]) and can be excised from 
the problems (P n ) and (D n ) (Lemma [5]). 

Example 2. If x G U n > K n let N(x) = mm{k : T~ fc (x) D A = 0}. Note 
that jV(ar) + 1 < N(T(x)) (where N(y) = oo if y (£ U n > K n ). Define if; = 
(a/2) N . Then -(a/2)ip = (pt/2)if)-onj) > ipoT-aip. Hence l Al ipoT-aip < 
on U n > K n . 

Lemma 4. Let a G (0, 1) and suppose thatip G L°°(A; m) satisfies l^^oT < 
ot^. Then tp\ Uk>0 H k > arec? VUvCk, — 0- In particular, m(iJ 00 n supp{ip)) = 
0. 

Proof. First, let x G f/i. Then Iai(^) = so = ° < ai[)(x), so 

V'l-ffi > 0- Now suppose that x G H^. Then T fc_1 (x) G i?j so that 

< tp(T k ^ 1 (x)) < ai){T k - 2 {x)) < ■ ■ ■< a k ^^{x). 
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Thus, ip\ii k — 0. On the other hand, if x £ then for each k > there 
is at least one X-k such that T k (x-t) = x. Then if>(x) — if) a T k (x-t) < 
a k if)(x- k ) < Qj^UV'lloo- Letting k — > oo, V(^) < 0. □ 



To apply Theorem [2] when / we need to ensure that the chosen test 
functions {if}j}^ = x are unable to detect bad functions. To do this, we exploit a 
basis specific domain reduction: remove from the domain A the support 
of any function h = M*A where h < and A G Range(M)/span{e}. Let A 
denote this reduced domain. 

Lemma 5. In the notation of this section, suppose that A is measurable and 
f G T n . Then f = fl^ m-a.e. 



Proof. Suppose that m(supp(/) \ A) > and let A be such that A T e = 0, 
M*A < and supp(M*A) fl supp(/) C A \ A has positive measure. Then, 
M/ = aeso that = A T (M/) = f AQ M*\fdm < 0, an obvious contradic- 
tion. □ 



In view of Lemma [5j m can be replaced with rh = m\^ in the definition of 
the problem (P n ) without any change to the set T n . The value of the problem 
is also unchanged, since there is no contribution to H(f) from those places 
where / takes the value 0. The duality theory is now applied to the measure 
space (A ,m), and the corresponding dual problem is 

maximise Q(A) := a A T e - / exp(M*A - 1) dm s.t. A G R n+1 . (D n ) 

J A 

Notice that if M*A < m-almost everywhere, then the domain restriction 
ensures that M*A = m-a.e. Thus, all potentially problematic A have been 
pushed into kerM* (modulo rh). In particular, condition Q is satisfied 
for the reduced domain. The previous results can be collected in our main 
theorem. 

Theorem 3. Let a,n be fixed and suppose that A is measurable. Then (D n ) 
attains its maximum at finite A* and f n = 1^ exp(M*A* — 1) solves (P n ). 



14 



We note that M* may have nontrivial kernel (modulo m), so the optimising 
A* can be non-unique. We also note that the reduced domain depends on n, 
possibly a and may be very difficult to determine in general. 



A MAXENT procedure for approximating ACCIMs 



Henceforth we make a specific choice of test functions, reminiscent of Ulam's 
method [221 [13]. Suppose that {i/jj} are obtained from a sequence of increas- 
ingly fine partitions of A. In particular, let B n be a partition of A into mea- 
surable subsets {£>i, . . . ,B n } and put ipj — 1b 3 - Notice that 1a = Y^j^i^j 
so the partition of unity assumption is satisfied. 

To derive and solve the optimality equations for (D n ), notice that M*A is a 
piecewise constant function, on elements of B n V {T~ 1 B n , Hi}: 

n n 

M*X = l Al ( A o + Xj - a X k )l B] o Tl Bk + l Hl J2(~ a A *) 1 b* 

j,k=l k=l 
n n 

= ^2(^o + Aj - a A fe )l BfcnT -i_B. - a A fe l^nBk (5) 
j,k=i fc=i 

(note that l Al = Iaht-M = Sjjt ^nT-^)- 

Definition 6. For the partition B n , form a matrix C and vector c by putting 

Ckj = rn(Bk n T^ 1 Bj) and = m(Hi PI j, fc = 1, . . . , n. 

A set 5j is reachable from B^ if there is n > such that (C n )kj > 0; write 
j. 

Lemma 6. Suppose that (T, A, m) zs a nonsingular open dynamical system 
and that ^ holds. Fix a, n and let A be the reduced domain when M* is 
constructed from the partition B n . Then A is the union of those Bk where 
either k k or there is at least one i for which i i k; in particular, A 
is measurable. 
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Proof. Let A T e = and suppose that M*A < 0. From equation (J5]), we 
immediately have 

Xj < a\k when Cjy > and \k > when Ck > 0. 

Since C is a non-negative matrix, i k iff there is a string i = zq, ii . . . , i n = 
k such that each > 0. Thus, by induction, if i ~» k then there is 

an n > such that A& < ct n Aj. First, if c& > and i ~> we infer that 
Aj > 0. Next, since m{A QO ) = 0, for every Bi there is an n for which 
m(Bi fl i? n ) > 0. Then, since T is nonsingular, there is B\ such that Cu > 
and m[B\ fl H n -i) > 0. By induction, there is a for which i ^ k and 
Cfc > 0. Hence, Aj > for all i. Now, if k /c, again use the inequality 
Afc < a n Afc to infer that A^ < and hence A& = 0. Similarly, if % i -w A;, 
Afc < a n A, = 0, so also A^ = 0. Suppose that is one of the indices 
identified in the statement of the lemma. Then (|5]) implies that ls fe M*A = 
Xjl Bk nT-^B 3 > 0; since M*X < 0, B k n supp(M*A) = 0. To complete the 
proof, let K. denote those k which fail the condition in the statement. For 
each such k, let N(k) = max{N : (C N )f k > 3i}; N(k) may be 0. (Note 
that if (C N )ik > for iV > n then there is a sequence i = io, i\, . . . , i n = k for 
which C ilil+1 > 0; this list must contain at least one repeat, implying k £ fC.) 
Note that if > then N(i) + 1 < N(k). Finally, for each k E K, put 
X k = {a/2) N $\ with A fc = for k <£ K. Then, C ik > implies Af(a/2) > A fc . 
Hence A^, - a Aj < -A^ < 0. It follows that supp(M*A) = U kelc B k . This 
completes the proof. □ 

Remark 4. The set A identified by the lemma is the union of all Bk which 
are reachable from the strongly connected components of the directed graph 
implied by the non-zero elements of the matrix C. This can be found quickly 
and easily. Note also that the entries of the matrix C are the same data 
needed to compute the (sub)stochastic transition matrices used by Ulam's 
method. 



Now, form the matrix C and vector c by retaining those entries where Bk is 
identified as belonging to A, and setting the rest to 0. These ingredients are 
all that are needed to obtain explicit formulae for the optimality conditions 
for (D n ). Using equation (pi), 



Q{X) = aX - ^ ex P(-^o -1 + Xj-a X k )C kj - ^ exp(-l - a X k ) c k . 

jk k 
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Because Q is different iable and concave, the maximising A* is found by solv- 
ing the first order conditions = 0. The following lemma writes these 
conditions in a more convenient form. 

Lemma 7. Assume the conditions of Lemma\^ and let A be as given there. 
Let C, c be obtained similarly to Definition^ but using rh = m\^ in place of 
m. If {xi}™ =1 are positive numbers solving 

Xg = a 



Y2k Cki%k 



and Aq satisfies e aX o 1 J^ . C i jXjX i a = a then A* := log(a;j) — Aq give the 
solution to (D n ). 



Proof. By differentiation, the optimality equations for (D n ) are 
= a - J2jk ex P(-^o - 1 + Aj - a X k )C kj (i = 0) 

= aJ2j exp(A - 1 + Xj - a A^C^- - J2k ex P(-^o - 1 + A 4 - a X k )C ki 

+a exp(— 1 — a Xi) di (1 < i < n). 

The % = equation is a normalisation. By putting xi = e Xi+x ° for 1 < % < n 
the latter equations are equivalent to 

= a 22 CijXjXt 01 - 22 CkiXiX^ 01 + a hx~ a . 

j k 

Multiplying by and rearranging gives the equations in the statement of 
the lemma. □ 



Precis of the method 



Under the conditions of Theorem [T] there are many ACCIMs for each escape 
rate. If at least one of these has a density with finite Shannon-Boltzmann 
entropy then the solutions of a sequence of problems (P n ) will converge (in 



17 



L 1 ) as n — > oo to the density of an ACCIM. This, in principle, allows one to 
select an "entropy maximising" ACCIM; the entropy maximisation spreads 
mass as uniformly as possible, given the condition of being a CIM. Solutions 
to each problem (P n ) can be calculated via convex duality, provided there are 
no "bad functions" (M*A which fail the condition Q in Theorem [2]). This 
condition can be ensured by a basis dependent domain reduction (Lemma [5] 
and Theorem leading to a domain reduced dual problem (D n ) that can 
be solved numerically. We propose an algorithm based on test functions 
associated with partitions of A. 



1. Specify a (= e~ p where p is the preferred escape rate). 

2. Fix a measurable partition B n = {Bj}J =1 of A. 

3. Obtain the matrix C and vector c of partition overlap masses (as spec- 
ified in Definition [6]). 

4. Use Lemma [H] to identify A and thus form the dual problem (D n ). 

5. Solve the optimality equations via Lemma [7j This can be accomplished 
with a fixed point iteration: set x = [1, . . . , 1] T and iterate 

x m = *(xt) where [tf (x)]* = I a ' 



until desired accuracy is achieved. 



6. Recover the optimal A* via Lemma [7] and solution f n>a to (P n ) from 
Theorem [3j 

7. (Optional) Calculate H(f n ^ a ). 



Sketch proof of convergence of the fixed point iteration 

Assume the escape hypothesis Q. 
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Without loss of generality, assume that all sums in the definition of \I/ are 
nonempty ^1 Because (D n ) actually has a solution, there is y* for which 
\£( y *) = y*. For any x G 1R™ let 

f 1 x- 
V(x.) =mm<R : — < — < R.Ki <n 

y } \ R-y*- 

Clearly V(x.) > 1 and V(x) = 1 iff x = y*. Moreover, 

\ t>) V/ ;,7/j • r, 



(6) 

Together with a similar inequality involving 1/V, one has V o ^ < V . Thus 
{Vo$*(xo)} is a decreasing sequence, bounded below by 1. Because V(x ) < 
oo, all {x 4 } are confined to a closed, bounded rectangle in M n ; let x* be a 
limit point of {x t }. Then V o ^(x*) = V(x H< ). 

Suppose that i is such thatn [^(x*)]i = V(x*)?/*. An inductive argument 
(using the equality form of (J6|)) shows that [x*]fc = V(x*)?/^ and = V^x*)^ 
whenever i k. Since there is at least one k with > reachable from i, 
V(x*) = 1. Thus x* = y* and x t -)■ y*. 



5 Examples 



We present two simple examples to demonstrate the effectiveness of the 
method; each implementation takes only a few dozen lines of Matlab code. 

Example 3 (Tent-map with slope 3). Let X — R, A — [0, 1] and put 

rn = J 3x x < 0.5 

\ 3(1 -x) x > 0.5 

3 Note that Ck% — Vfc only if i?i n A — 0. In this case also each CV,- = c, = and the 
value of M*A on i?i is irrelevant to the solution of (P n ) (by Lemma [5]). The function 4" 
can be defined to be 1 on such coordinates. 

4 A similar argument works if i is such that [^(x*)]j = y*/V(x*). 
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Then, A x = [0,1/3] U [2/3,1] and H x = (1/3,2/3). The "natural" AC- 
CIM is Lebesgue measure with density /* = 1, and corresponding value of 
a = 2/3. In this case, K n = = (for all n) and the survivor set 
Q = is the usual middle thirds Cantor. At a selection of values of 
a 6 (0, 1) we applied the MAXENT method using the partition based test 
functions {ipj = l[(j-i)/iooQ,j/iooo)}}=°i°- The results are depicted in Figure [TJ 
As expected, for values of a near 0, escape is rapid and the ACCIMs are 
strongly concentrated on the hole Hi and its first few preimages. For a near 
1, escape is slow and the ACCIMs are more strongly concentrated around the 
repelling Cantor set A^. The MAXENT method can be tuned to produce a 
"most uniform" approximate ACCIM, and the maximal entropy solution is 
in fact the constant density function, appearing at a = 2/3. 

Example 4 (A linear saddle). Let A = [— 1,1] 2 and m Lebesgue measure 
onI = E 2 ; put T(x,y) = (2x,0.8y). Then K n = [-1,1] x ±(0.8( n+1 \ 0.8 n ], 
^ = {0} x [-1, 1] and H x = [-1, 1] x {0} \ (0,0). This linear map has a 
saddle-type fixed point at (0, 0). The only invariant measure is the delta mea- 
sure at 0. All conditionally invariant measures are supported on the local 
unstable manifold to the origin; in this case, the segment of the x-axis con- 
tained in A. Indeed, m(ifoo) = and there are no ACCIMs. There are, how- 
ever, many CIMs which are AC with respect to the one-dimensional Lebesgue 
measure on the x-axis, and these are detected by the numerical method. The 
domain reduction to A is nontrivial here, leading to a localisation in support 
of the MAXENT approximations. Calculations were performed for several a, 
with 10000 test functions being the characteristic functions of a 100 x 100 
subdivision of A; in this case the set A = [-1, 1] x [-0.08,0.08]. Some CIM 
estimates are presented in Figures [2] and |3j 



6 Concluding remarks 



The MAXENT approach to calculating approximate ACCIMs has a sound 
analytical basis (from optimisation theory), and is easy to implement. With 
test functions {ipj} derived from a partition of phase space, the basic dy- 
namical inputs to the computational scheme are the integrals J ipj oT^ dm 
(which could be estimated from trajectory data). For each choice of test 
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0,5 0,55 0,6 0,65 0,7 11,75 0,8 




.35 



Figure 1: Example [3] Above: (neg) entropy —H(f n ^ a ) of slope 3 tent map 
ACCIMs, depending on a computed via MAXENT with uniform n = 1000 
subinterval partition of [0, 1]. Below: densities of the computed ACCIMs as 
a function of x G [0, 1] and a. 21 
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Figure 3: Example |4| MAXENT approximations of CIMs for for a = 0.6 
(above) and a = 0.75 (below) for an open system with a simple saddle. 
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functions, feasibility of the dual optimisation problem depends on reducing 
the domain of the problem to exclude certain 'backwards transient' parts of 
the phase space. With test functions derived from a partition, the resulting 
'reduced domain' covers any recurrent set, and local unstable manifolds. 

The work reported in this paper suggests a number of avenues of future 
enquiry: 



• are entropy-maximising ACCIMs of any particular dynamical relevance? 

• given that the analysis and computation of the variational approach is 
similar with convex functionals other than H(-), are other choices of 
objective more appropriate? 

• how is the quality of approximation effected by the choice of test func- 
tions {?/> fc }? 

• how does the functional H(f n<a ) depend on a (and n)l 

• can dynamically interesting measures on unstable manifolds be recov- 
ered from this approach? 
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